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SYMMETRIC  DUAL  QUADRATIC  PROGRAMS 


I.  Introduction 

The  duality  theory  of  q.uadratic  programming  has  heen  studied  by  Dennis  [  1  ] 
and  principally  by  Dorn  [2,3,4].  In  [  7  ]  >  Wolfe  treated  the  restriction  of  his 
results  in  nonlinear  duality  to  the  case  of  quadratic  programming. 

In  this  paper,  two  quadratic  programs  are  presented  which  are  dual,  naturally 
symmetric,  and  related  to  a  self-dual  quadratic  program.  It  is  a  consequence  of 
the  duality  of  these  programs  that  if  either  has  an  optimal  solution,  then  they 
share  an  optimal  solution  in  common.  Since  duality,  symmetry,  and  self -duality 
have  each  been  studied  by  Dorn,  some  attention  is  given  to  the  relation  between 
the  present  work  and  his. 

Consider  the  quadratic  programs : 


PRIMAL  PROBLEM 

(la) 

Minimize 

F(x.,y)  = 

1 

2 

x'Cx  +  ^ 

* 

y*C  y 

+  P  'x 

(lb) 

subject  to 

Ax  + 

* 

c  y 

IV 

1 

a* 

(Ic) 

and 

X 

^0  (y  unrestricted) 

DUAL 

PROBLEM 

(2a) 

Maximize 

G(u,v)  = 

1 

“2 

u'Cu  -  5 

* 

v'C  V 

b '  V 

(2b) 

subject  to 

Cu  - 

A'v 

IV 

1 

(2c) 

and 

V 

^0  (u  unrestricted) 

COMBINED  SELF-DUAL  PROBLEM 

(3a) 

Minimize 

II 

X 

* 

y'c  y  + 

x'Cx 

+  p 'x  +  b  'y 

(3b) 

subject  to 

* 

C  y  + 

Ax 

^  -b  , 

(3c) 

-A'y  + 

Cx 

^  -P  . 

(3<i) 

y 

IV 

o 

(3e) 

and 

X 

o 

Al 

Notation  and  Terminology 


The  entries  of  all  matrices  and  vectors  are  real  numbers.  The  matrices 
* 

A  ,  C  ,  and  C  are  mxn,  nxn,  and  m  x  m  ,  respectively.  The  latter 

two  are  ass\jmed  to  be  symmetric  with  positive  seml-deflnlte  quadratic  forms. 

The  symbols  x  ,  u  ,  or  p  and  y  ,  v  ,  or  b  denote  n-  and  m- component 

coliomn  vectors,  respectively.  The  components  of  x  ,  y  ,  u  ,  and  v  are 

* 

variables,  whereas  those  of  A  ,  C  ,  C  ,  p  ,  and  b  are  constants.  The 
transpose  of  a  matrix  or  a  vector  is  denoted  by  a  prime.  An  Inequality  between 
vectors  means  that  the  stated  inequality  holds  between  each  of  the  correspond¬ 
ing  components.  The  symbol  <t>  denotes  the  empty  set. 

Problem  (l)  is  ca2J.ed  the  primal  problem,  and  (2)  is  called  the  dual 
problem.  A  pair  (x,y)  of  vectors  Is  called  feasible  for  (l)  if  it  satisfies 
(lb)  and  (Ic).  Similarly,  a  pair  (u,v)  is  feasible  for  (2)  if  it  satisfies 
(2b)  and  (2c).  The  set  of  all  feasible  pairs  of  vectors  for  the  primal 
problem  (l)  is  called  its  constraint  set,  .  The  constraint  set  of  the 
dual  (2)  is  denoted  by  .  If  the  constraint  set  of  a  problem  is  empty 
(i.e.,  ^  =  4)  or  =  <t>)  the  problem  is  said  to  be  infeasible.  A  problem 

is  solvable  if  its  constraint  set  contains  a  pair  for  which  the  objective 
function  (F  in  (l)  or  G  in  (2))  attains  the  desired  extremum;  such  a  pair 
is  an  optimal  solution  of  the  problem.  The  sets  ^  and  /S ^  C  ^ 

denote  the  optimal  solutions  of  (l)  and  (2),  respectively. 

It  will  be  shown  that  a  relation  of  duality  holds  between  (l)  and  (2) 
in  the  sense  (see  [7])  that: 

(l)  sup  G(u,v)  ^  inf  F(x,y)  ; 

(li)  the  solvability  of  one  problem  implies  that  of  the  other,  and  the^ 
extremal  values  of  F  and  G  are  equal; 

(iii)  if  one  problem  is  feasible  while  the  other  is  not,  then  on  its 
constraint  set,  the  objective  function  of  the  feasible  problem 
is  unbounded  in  the  direction  of  extremization. 
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It  is,  of  covirse,  possible  for  both  the  primal  and  the  dual  problems  to  be 
Infeasible  (i.e., 

*  r  1 

When  C  is  the  zero  matrix,  the  dual  problems  of  Dorn  [2]  result.  When 
* 

both  C  and  C  are  zero  matrices,  the  familiar  von  Neumann  symmetric  dual 
linear  programs  appear. 


Problem  (2)  can 

be  converted  to  a  minimization  problem: 

(^) 

Minimize 

-G(u,v) 

=  ^  v'C*v 

+  2  a '  Cu  H- 

»  . 

(to) 

subject  to 

(-A')v 

+  Cu  ^ 

-P 

(to) 

and 

V 

0 

(u 

unrestricted) 

With 

(4)  as  the  primal  problem. 

the  dual 

is : 

(5a) 

Maximize 

-F(x,y) 

=  -i  yc  y 

-  ^  x'Cx  - 

p '  X 

(5b) 

subject  to 

* 

c  y 

-  (-A')x^ 

-b 

(5c) 

and 

X  k 

0 

(y 

unrestricted) 

But  (5)  is  obviously  equivalent  to  (l).  Roughly  speaking,  then,  the  dual  of 
the  dual  is  the  primal.  It  is  precisely  this  involutory  property  which  Dorn  [5] 
calls  symmetry. 

II.  Duality 

THEOREM  1:  sup  G(u,v)  ^  inf  F(x,y)  . 

PROOF:  Using  the  convention  of  [7]  that 


if 

/)  =  't> 

> 

sup 

G  =  -  00 

if 

'b 

II 

■a 

? 

inf 

F  =  + 

it  remains  to  prove  the  inequality  under  the  assumption  that  both  problems 
are  feasible.  Let  (x,y)  e  ^  and  (u,v)  e  ^  .  Since  x  ^  0  and  v  ^  0  , 
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* 

-b'v  -  y'C  v^x'A'v^p'x  +  x'Cu 
Applying  the  inequalities 

^  ^  ^ 

2y'C  V  ^  y'C  y  +  v’C  v 

2x'Cu  ^  x'Cx  +  u'Cu 

which  follow  from  (y  -  v)'C  (y  -  v)  ^  O  and  (x  -  u)'C(x  -  u)  ^  0  because 
* 

C  and  C  are  symmetric  and  positive  semi -definite, 

-b'v  -  5  y'C  y  -  5  VC  V  ^  p'x  +  x'Cx  +  ^  u'Cu 
and  by  transposing, 

G(u,v)  =  u'Cu  -  2  y'C*V  -  b'v  ^  ^  x'Cx  +  ^  y'C  y  +  p'x  =  F(x,y) 

This  completes  the  proof  of  Theorem  1. 

A  solvable  quadratic  program  is  related  to  a  certain  linear  program.  By 
means  of  this  correspondence,  the  duality  theorem  of  linear  programming  may 
be  employed. 

LEIMMA:  Let  optimal  solution  of  (l).  Then  (x^,y^)  is  an 

optimal  solution  of  the  linear  program: 

(6a)  Minimize  f(x,y)  =  (x^C)x  +  (y^C  )y  +  p'x 

(6b)  subject  to  Ax  +  C  y  ^  -b 

(6c)  and  x  ^  0  • 

REMARK:  This  Lemma  is  a  special  case  of  one  where  the  objective  function  F 
in  (la)  is  replaced  by  a  differentiable  convex  function  and  the  linear  ob¬ 
jective  form  in  {<6a.)  is  replaced  by  the  gradient  of  the  new  objective  function 
(transposed)  times  the  variables.  The  proofs  of  the  two  Lemmas  are  completely 
analogous;  that  for  the  quadratic  function  F  will  be  given  here- 
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PROOF:  (l)  and  (6)  have  the  same  constraint  set,  7®  .  Suppose  these  exists 
(x,y)  e  ^  such  that  f(x,y)  -  f(x^,y^)  <  0  .  This  means 

(7)  (XqC  +  p')(x  -  x^)  +  (yT*)(y  -  y^)  <  0 

Let  0  <  X  <  1  ,  and  define 

X  =  (1  -  'K)x  +  ?oc  =  X  +  ^(x  -  x  )  , 

o  o  o 

*  _  _ 

y  =  (1  -  >^)y^  +  y<y  =  +  My  -  y^) 

Since  7®  is  convex,  (x  ,y  )  €  ^  .  Consider 

(8)  F(x*,y*)  -  F(x^,y^)  =  X[(x^C  +  p')(x  -  x^)  +  (y^C*)(y  -  y^)] 

+  7^  [(x  -  x^)'C(x  -  x^)  +  (y  -  y^)'C*(y  -  y^)] 

From  (7)  it  follows  that  the  right-hand  side  of  (8)  can  be  made  negative  for 
sufficiently  small,  positive  X  .  This  contradicts  the  assumption  that 
(Xo,yo)  is  an  optimal  solution  of  (l).  Therefore,  niust  be  optimal 

for  (6). 

THEOREM  2:  ^  is  an  optimal  solution  of  (l),  there  exists  an 

optimal  solution  of  (2).  Furthermore,  the  extremal  values  of  F  and  G 
are  equal. 

PROOF:  By  Theorem  1,  if  there  exists  (u,v)  e  J9  such  that  G(u,v)  =  F(x  jy^) 

then  (u,v)  e  .  By  the  Lemma,  (x^,y^)  is  optimal  for  (b).  The  duality 

theorem  of  linear  programming  (cf.  e.g.,  [b] )  states  that  there  exists  a 

vector  V  such  that 
o 

Cx  -  A'v  >  -p 
o  o  ^ 

v'C*  =  y'C* 
o  o 
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and 


(9) 


-b'v  =  x'Cx  +  y'C  y  +  p'x 
o  o  o  o  o  o 


Notice  that  ^  ^  symmetry  of  C  , 

^  -K*  -M- 

v'C  V  =  v'C  y  =  y'C  v  =  y'C  y 
o  o  o  o  o  o  o  o 


Thus,  from  (9) 


F(Xo,yo) 


=  5  x'Cx  +  i-  y'C  y^  +  p'x 


-4  x'Cx  -4y'Cy  -b'v 

OO  “^*^0  0  o 


=  x^Cx  -  I  v'C  V  -  b'v 
^00^00  o 


=  a(x^,v^)  , 


and  the  proof  is  complete. 

The  demonstration  of  Theorem  2  provides  the  important 

COROLLARY  1:  If  (x  ,y  )  €  ^  ,  there  exists  a  vector  v  such  that 

o’^^o  o'  o 

(x  ,v  )  G  /’  ,  and  G(x  ,v  )  =  F(x  ,y  )  . 

o'  o  o  o  o  o  o 

This  Corollary  and  the  symmetry  established  above  yield 

COROLLARY  2:  If  (u  ,v  )  g  ^  ,  there  exists  a  vector  x  such  that 

(x  ,v  )  G  ,  and  F(x  v  )  =  G(H.,v  )  . 

^  o'  o  o'  '  o'  o  o' 

COROLLARY  Nonnegativity  restrictions  may  be  extended  to  the  variables 
y  or  u  without  affecting  the  question  of  solvability  of  (l)  or  (2). 

THEOREM  5:  If  (l)  is  feasible  and  (2)  is  infeasible,  then  inf  F(x,y)  =  -oo 

(x,y)G7> 

PROOF:  Let  (x,y)  g  .  The  assumption  that  c/P  =  <s>  means  that  there 
exist  no  vectors  u  and  v  satisfying 
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It  follows  (cf.  [6],  p.  k6)  that  there  exist  vectors  x  ^  0  and  y  ^  0 
such  that 


In  particular, 

ly*  =  Ax*  ^  0 

* 

Cx  =  0 

* 

p'x  =  -1 

^  *  — 

With  ^  0  ,  it  follows  that  (x  +  Xx  ,  y)  e  ^  .  However, 

F(x  +  Ax  ,  y)  =  -A  +  F(x,y) 

Clearly,  lim  F(x  +  Ax  ,  y)  =  -co  . 

A  00  # 

Again  the  symmetric  result  holds. 

COROLLARY  1:  If  (2)  is  feasible  and  (l)  is  infeasible,  then  sup  G(u,v)  =  oo. 

(u,v)e  ^ 

Theorems  1  and  5  and  Corollary  1  have  the  immediate  consequence 


COROLLARY  2:  If  either  problem  (l)  or  (2)  is  feasible,  its  objective  function 
is  bounded  in  the  direction  of  extremization  if  and  only  if  the  other  problem 
is  feasible. 


The  duality  relation  is  now  fully  established. 
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In  view  of  Theorem  2  and  its  Corollaries  it  is  not  surprising  to  find  that 
if  either  (l)  or  (2)  is  solvable,  there  exists  a  common  optimal  solution  for 
(l)  and  (2). 


THEOREM  4  (Joint  Solution):  If  either  problem  (l)  or  problem  (2)  is  solvable, 
there  exist  vectors  x^  and  v^  such  that  Is  optimal  for  (l)  and 

(2) .  (in  this  case,  called  a  joint  solution. ) 

PROOF:  It  is  no  restriction  to  assume  that  ^  is  nonemptyj  let  (x  ,y  )  e 

O  ’  'o  o  o 

Then  there  exists  a  vector  v  such  that  (x  ,v  )  e  ^  .  Hence, 

o  o  o  o 


(10) 

Ax  +  C  y  >  -'b 
o  o  ^ 

o 

Al 

o 

X 

Cx  -  A'v  >  -p 
o  o 

o 

Al 

o 

> 

and 

1  1  ^  1 
g  x'Cx  +  i  y'C  y  +  p'x  = 
oo  ‘^“'o^o  o 

1  * 

x'Cx  -  2  v'C  V  -  b 'v 

0  0*^00  0 

The  latter 

implies 

(11) 

x'Cx  +  p'x  =  -g  y'C*y 
o  o  -^0  o  ^  o 

-  i  v'C*v  -  b'v  , 

*^0  0  o' 

and  the  inequalities  (10)  imply 


X  'Cx 
o 


o 


+  p'x  >  v'Ax  >  -v’C  y 
0^0  0^  0*^0 


'V  >  -g  y'C  y 
o  ^  ^  0  O 


1 

2 


* 

V’C  V 
o  o 


b '  V 

o 


By  (ll),  equality  holds  throughout  and 


* 

v'C  y 


■3  y'C  y 
2  •'o 


* 

v'C  V 


Therefore  (v  "y)'C(v  -  y)  =  0,  from  which  C  v  =  C  y  follows, 

o  o  ^  o  o  ^  0*^0 

(See  App.  g,  [  t].)  Hence  (x^,v^)  e  ^  ,  and  F(x^,v^)  =  F(x^,y^)  ,  so 

(x  ,v  )  e  f  . 

^  o’  o  '  o 
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REMAEK  (Complementary  Slackness):  Let  (x^,v^)  be  a  joint  solution  of  (l) 
and  (2).  Define 


s  =  Ax 

+  C  V 

+  b 

0  0 

0 

c+ 

II 

0 

X 

-  A*v 

+  P 

0  0 

0 

Then 

(12)  s 'v  =  0  ,  and  t'x  =  0 

This  property,  can  be  deduced  directly  or  as  a  consequence  of  the 
Kuhn-Tucker  conditions. 

In  the  case  of  linear  programming,  the  feasibility  of  both  the  primal 
and  the  dual  problems  implies  the  existence  of  optimal  solutions  for  each 
of  them.  Although  this  is  not  generally  true  in  nonlinear  programming,  it 
is  in  quadratic  programming. 

THEOREM  5:  If  both  (1)  and  (2)  are  feasible,  then  the  Infinimum  of  F  over 
^  is  attained  on  'P  and  the  supremum  of  G  over  jO  is  attained  on 
(Moreover,  (l)  and  (2)  have  a  joint  solution.) 

PROOF:  Because  P  and  are  each  nonempty,  F  is  bounded  below  on  P 

and  G  is  bounded  above  on  .  To  the  latter,  with  some  variations  in  the 
proof,  may  be  applied  App.  i  of  [5]  ,  to  the  effect  that  G  must  attain  its 
supremum  (over  J9  )  on  P  .  The  remainder  of  the  proof  is  an  application 
of  Corollary  2,  Theorem  2.  The  assertion  in  paren  theses  is  true  by  Theorem  4 

III.  Self -Duality 

Consider  a  (primal)  problem  of  the  following  kind: 


(13a) 

Minimize 

/(z)  =  z 'Bz  + 

q'  z 

(13b) 

subject  to 

Bz  ^ 

-9 

(13c) 

and 

0 
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where  B  is  positive  semi -definite,  but  not  necessarily  symmetric.  If  B 
were  symmetric,  problem  (I3)  would  be  a  special  case  of  (l).  The  symmetry 
can.  Indeed,  be  brought  about  with  no  adverse  effects  on  the  problem.  Set 

B  =  i  (B  +  B' ) 


It  is  easy  to  verify  that: 

(i)  B  is  symmetric; 

(ii)  B  is  positive  semi-definite; 

(iii)  x'Bx  =  x'Bx  ,  for  aiJL  x  . 

Therefore  (Ij)  is  eq[uivalent  to: 


(I4a) 

Minimize 

V^(z)  =  z 'Bz 

+  q'z 

(I4b) 

subject  to 

Bz  ^  ■ 

-q 

(l4c) 

and 

0  . 

Dorn  [4]  has  proved  that  a  problem  of  the  type  (ij),  in  which  B  is 
further  assumed  to  be  positive  definite,  is  always  solvable,  has  Min  Y{z)  =  0  , 
and  is  self-dual.  If  the  hypothesis  of  positive  definiteness  is  exchanged 
for  positive  semi -definiteness  and  feasibility,  the  same  conclusions  are  valid. 

THEOREM  6:  If  (l4)  is  feasible  it  is  solvable  and  Min  /(z)  =  0  . 

PROOF:  For  any  feasible  z  ,  (l4b)  and  (l4c)  imply  /(z)  ^  0  ;  since  (f 
is  bounded  below  (l4)  has  an  optimal  solution.  The  dual  of  (l4)  is 

(15a)  Maximize  ^(u,v)  =  -u'Bu  -  q'v 

(15b)  subject  to  2Bu  -  B'v  ^  -q 

(15c)  and  V  ^  0  , 

and  it  is  solvable.  Multiplying  (l5b)  by  v  and  subtracting  u'Bu  from  both 
sides  of  the  inequality  yield 
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-u'Bu  +  2v'Bu  -  v'B'v  ^  -u'Bu  -  q'v 


from  which  it  follows  tliat 

(l6)  ^  ^  “  ('i  -  v)'B(u-v)  ^  -u'Bu  -  q'v  =  ^(u,v) 


Now 


0  ^  Min  Yiz)  =  Max  ij/{u,v)  ^  0 

so  that  Min  'f  (z)  =  0  . 

COROLLARY:  If  (l4)  is  infeasitle,  so  is  (15). 

PROOF:  In^proof  of  the  Theorem  it  was  shown  that  ij/  (u,v)  ^  0  whenever  (u,v) 
satisfy~"ti5BT'  ^.nd  (ijc).  But  ij/  cannot  be  bounded  above  if  (l4)  is 
infeasible. 

This  Corollary  shows  that  (14)  and  (15)  are  either  both  feasible  or  both 

infeasible.  Hence  it  is  sufficient  to  consider  only  the  case  where  (l4)  and 

('15)  are  both  feasible  —  and  hence  solvable.  Let  and  ^  denote  the 

00 

sets  of  optimal  solutions  of  (l4)  and  (15 )j  respectively. 


THEOREM  7: 

(i) 

(ii) 

PROOF : 

(i) 


Problem  (l4)  is  self -dual  in  the  sense  that 

z  e  implies  (z  ,z  )  e  ^  , 

0  0  0  0  o 

(u  ,v  )  G  implies  v  g  ^  • 

'00  o  o  o 


/(z) 

=  0  .  Now 

0 

0 

• 

2Bz 

0 

il 

0 

and 

N 

0 

IV 

0 

so  (z  ,z  )  G  •  Moreover, 
'  o'  o  ' 


tjAz  ,z  )  =  -z'Bz  -  q'z 
^  o’  o  00  ^  o 


/(z„)  -  0 


-11- 


I 

) 


and  therefore  (z  ,z  )  e  . 

o  o  o 

(ii)  Let  ^  '  Iiis^iuallty  (l6)  and  the  fact  that  ij/(u^,v^)  =  0 

imply 

Bu  =  Bv 
o  o 

This  and  the  symmetry  of  B  imply 


u'Bu  =  v'Bv 
o  o  o  o 


Now  V  >  0  ,  and 
o 

Bv  =  (Bv  +E'v)-B’v  =  2Bv  -  B'v  >  -q 

o  o  o  o  o  o'^^ 

Finally, 


/(v  )  =  v'Bv  +  q'v  =  -  -^(v  ,v  )  =  0  , 

'  ^  o  o  o  o  ^  ^  0  o  ’ 

so  that  V  €  ^  . 

o  o 

The  self-dual  program  (It)  is  not  entirely  artificial,  for  problem  (5) 
stated  in  Section  I  is  of  the  form  (15)  •  This  can  be  seen  by  setting 


and  ^(z)  =  H(x,y)  =  F(x,y)  -  G(x,y)  .  Theorem  7  shows  that  (3),  by  modifi¬ 
cation  to  the  form  (l4),  is  (equivalent  to)  a  self-dual  program. 

The  sense  of  self -duality  defined  in  Theorem  [  is  not  thoroughly  satis¬ 
factory.  It  is  known  that  by  combining  the  symmetric  primal  and  dual  problems 
of  linear  programming,  it  is  possible  to  obtain  a  formally  self -dual  problem. 
Indeed,  if  A  is  a  skew-symmetric  matrix,  the  linear  program 
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Moreover 


'®(U,V)  =  -  9iU,V)  ^  0 

where  <!>  is  the  dual  objective  function,  (19a).  Now 

0  ^  Min  (X,Y)  =  Max  (U,V)  ^  0 

whence  the  conclusion. 

A  true  combination  of  (l)  and  (2)  is: 


(21a) 

Minimize  K(x,y,u,v) 

=  iy 'C  y  +  iu  'Cu  f 

'C  V  -i-^x'Cx  +  b'v  +p'x 

(21b) 

subject  to 

C*^y  +  Ax  ^  -b 

(21c) 

-A'v  V  Cu  ^  -p 

> 

(21d) 

:>  0 

> 

(21e) 

and 

0 

• 

Under 

the  substitutions. 

it  is  clear  that  (2l)  is  of  the  form  (Ifl)  and  is,  therefore,  self-dual. 

To  answer  the  question  of  the  relation  b?tn.reen  the  self-dual  problems  (l4) 
and  (18),  note  that  the  former  can  be  written  as 

Minimize  /'(z)  =  5  z  Bz  -f  5  t'Bz  +  q'z 
subject  to  Bz  +  (B  -  bOz  -q 

and 

Now  B  is  symmetric  and  positive  semi -definite,  and  (B  -  B')  is  skew  symmetric. 
Thus  let  A  =  (B  -  B')  and  let  C  -  B  .  The  problem  above  becomes,  then. 
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(17a) 

(1Tb) 

(17c) 


Minimize 


q '  z 

subject  to  Az  ^  -q 
and  z  ^  0 

is  clearly  self-dual.  This  formal  self-duality  can  be  shewn  in  quadratic  * 
programming  as  well.  Consider  the  problem: 

(18a)  Minimize  ®(X,Y)  =  jY'CY+ix'CX  +  q'X 

(18b)  subject  to  CY  +  AX  ^  -q 

(18c)  and  X  ^  0 

where  A  is  skew  symmetric  and  C  is  symmetric  and  positive  semi -definite. 
The  dual  of  (I8)  is: 

(19a)  Maximize  ^(U,V)  =  -5  V 'CV  -  -g  U’CU  -  q'V 

(19b)  subject  to  -A’V  +  CU  ^  -q 

(19c)  and  V  ^  0  • 

Since  A  is  skew  symmetric,  (I9)  is  Just  (I8);  that  is,  (I8)  is  self-dual. 

THEORKM  8:  If  (18)  is  feasible,  Min  9{X,Y)  =  0  . 

PROOF:  Since  A  is  skew -symmetric,  X'AX  =  0  for  all  X  .  Let  (X,Y)  be 
feasible  for  (I8).  Taking  transposes  in  (I8)  and  multiplying  by  X  ,  it 
follows  that 


Therefore, 


Y'CX  ^  -q'X 


(20)  f(X,Y)  =  Y'CY  +  1  X'CX  +  q'X  ^  (Y  -  X)'C(Y  -  X)  ^  0 

Since  $  is  bounded  below  for  feasible  vectors,  (18)  is  solvable  —  and  so  is  (19). 
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(22a) 

Minimize 

‘/’(z)  =  4  z'Cz  +  ^  z'Cz 

+ 

(22b) 

subject  to 

Cz  +  Az 

-q 

(22c) 

and 

z 

0 

Thus  (l4)  and  (22)  are  the  same  problem.  If  z  is  feasible  for  (l4),  (z,z) 

is  feasible  for  (l8).  Furthermore,  if  z^  is  optimal  for  (l4),  then  (z^,z^) 
is  optimal  for  (l8)  because  y’(z^)  =  0  ,  the  minimum  value  of  ® 

On  the  other  hand,  if  (X^,Y^)  is  an  optimal  pair  for  (l8),  then  by 
Theorem  8  and  Equation  (20), 

0=  ^  (''o  -  -  V  ^  °  ■ 

Therefore  CX  =  CY  (as  seen  in  similar  arguments  above  '  so  that 
o  o 

/(Xo).  »(X^,X^)  .  0  . 

This  means  that  X^  is  feasible  and  optimal  in  (22),  hence  in  (14). 

These  remarks  show  that  (14)  and  (18)  are  equivalent  problems.  The 
proof  of  this  equivalence  closely  parallels  that  of  Theorem  7.  It  may  be 
more  accurate,  therefore,  to  say  that  (14)  is  actually  equivalent  to  its  dual. 
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